View-Invariant Representation and Learning of Human Action
نویسندگان
چکیده
Automatically understanding human actions from video sequences is a very challenging problem. This involves the extraction of relevant visual information from a video sequence, representation of that information in a suitable form, and interpretation of visual information for the purpose of recognition and learning. In this paper, we first present a view-invariant representation of action consisting of dynamic instants and intervals, which is computed using spatiotemporal curvature of a trajectory. This representation is then used by our system to learn human actions without any training. The system automatically segments video into individual actions, and computes view invariant representation for each action. The system is able to incrementally learn different actions starting with no model. It is able to discover different instances of the same action performed by different people, and in different viewpoints. In order to validate our approach, we present results on video clips in which roughly 50 actions were performed by five different people in different viewpoints. Our system performed impressively by correctly interpreting most actions.
منابع مشابه
A View-Invariant Representation of Human Action
The representation plays an important role in recognition and understanding of human action from video sequences. A view-invariant representation of action consisting of dynamic instants and intervals, which is computed using spatiotemporal curvature of a trajectory, is presented. In order to validate our representation, we report experiments on several different actions performed by different ...
متن کاملMulti-view action recognition based on action volumes, fuzzy distances and cluster discriminant analysis
In this paper, we present a view-independent action recognition method exploiting a low computational-cost volumetric action representation. Binary images depicting the human body during action execution are accumulated in order to produce the so-called action volumes. A novel time-invariant action representation is obtained by exploiting the circular shift invariance property of the magnitudes...
متن کاملView-Invariance in Action Recognition
Automatically understanding human actions using motion trajectories derived from video sequences is a very challenging problem. Since an action takes place in 3-D, and is projected on 2-D image, depending on the viewpoint of the camera, the projected 2-D trajectory may vary. Therefore, the same action may have very different trajectories, and trajectories of different actions may look the same....
متن کاملON THE USE OF KULSHAMMER TYPE INVARIANTS IN REPRESENTATION THEORY
Since 2005 a new powerful invariant of an algebra has emerged using the earlier work of Horvath, Hethelyi, Kulshammer and Murray. The authors studied Morita invariance of a sequence of ideals of the center of a nite dimensional algebra over a eld of nite characteristic. It was shown that the sequence of ideals is actually a derived invariant, and most recently a slightly modied version o...
متن کاملLearning Human Identity Using View-Invariant Multi-view Movement Representation
In this paper a novel view-invariant human identification method is presented. A multi-camera setup is used to capture the human body from different observation angles. Binary body masks from all the cameras are concatenated to produce the so-called multi-view binary masks. These masks are rescaled and vectorized to create feature vectors in the input space. A view-invariant human body represen...
متن کامل